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Abstract 

Background: Three-dimensional ultrasound (3DUS) at simulation compared to 3DUS at treatment is an image 
guidance option for partial breast irradiation (PBI). This study assessed if user dependence in acquiring and 
contouring 3DUS (operator variability) contributed to variation in seroma shifts calculated for breast IGRT 

Methods: Eligible patients met breast criteria for current randomized PBI studies. 5 Operators participated in this 
study. For each patient, 3 operators were involved in scan acquisitions and 5 were involved in contouring. At CT 
simulation (CTl), a 3DUS (USl) was performed by a single radiation therapist (RT). 7 to 14 days after CTl a second 
CT (CT2) and 3 sequential 3DUS scans (US2a,b,c) were acquired by each of 3 RTs. Seroma shifts, between USl and 
US2 scans were calculated by comparing geometric centers of the seromas (centroids). Operator contouring 
variability was determined by comparing 5 RTs contours for a single image set. Scanning variability was assessed 
by comparing shifts between multiple scans acquired at the same time point (USl-US2a,b,c). Shifts in seromas 
contoured on CT (CT1-CT2) were compared to US data. 

Results: From an initial 28 patients, 15 had CT visible seromas, met PBI dosimetric constraints, had complete US 
data, and were analyzed. Operator variability contributed more to the overall variability in seroma localization than 
the variability associated with multiple scan acquisitions (95% confidence mean uncertainty of 6.2 mm vs. 1.1 mm). 
The mean standard deviation in seroma shift was user dependent and ranged from 1.7 to 2.9 mm. Mean seroma 
shifts from simulation to treatment were comparable to CT. 

Conclusions: Variability in shifts due to different users acquiring and contouring 3DUS for PBI guidance were 
comparable to CT shifts. Substantial inter-observer effect needs to be considered during clinical implementation 
of 3DUS IGRT 
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Background 

The target for partial breast irradiation (PBI) and boost 
radiotherapy relies on definition of the seroma or healing 
surgical bed plus a margin [1,2], but the ideal method 
to define the target for PBI remains unclear [3]. Clin- 
ical examination is inaccurate resulting in 50-80% of 
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the seroma receiving inadequate dose [4]. Using surgi- 
cal clips to define the target has been associated with a 
higher recurrence rate [5], smaller volumes compared to 
CT-delineated volumes [6], and clips are uncommonly 
placed by surgeons. It has been proposed that daily cone 
beam CT (CBCT) of the excision cavity is optimal during 
external beam PBI [7], however, this is not unanimous 
[8,9] and daily CBCT increases integral dose. 

Ultrasound (US) provides good image quality in breast 
tissue, is non-ionizing, and identifies the seroma in most 
breast cancer patients [10,11]. One distinction between 
3DUS and other image-guided radiotherapy (IGRT) 
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modalities is the user dependence of the image acquisition 
process that may result from scanning variability, patient 
respiration, probe pressure, selected image settings, and 
the chosen contouring strategy. In most clinical radiother- 
apy departments it is likely that multiple operators would 
be involved with the scanning and contouring tasks asso- 
ciated with a breast cancer patients US guided treatment. 
This study aimed to determine the extent to which oper- 
ator variability in 3DUS acquisition and seroma contour- 
ing contributed to differences calculated for breast IGRT. 

Methods 

Study subjects 

Eligible subjects were women undergoing CT simulation 
for adjuvant whole breast radiotherapy. Inclusion cri- 
teria were age > 40 years, pathologically confirmed ductal 
carcinoma in-situ (DCIS) or invasive ductal breast can- 
cer < 3 cm diameter treated with breast conserving 
surgery with negative margins. Women were excluded 
if they had mastectomy, lobular histology, multicentric 
disease, bilateral breast cancer, or if their CT simulation 
was > 14 weeks after the last breast surgery. This study 
was approved by the institutional research ethics board. 
All subjects provided written informed consent. 

3D ultrasound system 

3DUS was performed using the Clarity (Clarity™, Elekta 
Soft Tissue Visualization, Montreal, Quebec) US system 
that consists of three components: a 10-MHz probe with a 
linear transducer array to collect US images; a computer 
system to reconstruct and display the images, and an infra- 
red imaging system to track the location of the US probe 
in the CT room. The US and CT images were implicitly 
registered through a shared common coordinate system. 

The Clarity System is equipped with two different con- 
touring platforms: [1] Workstation Mode', which is an off- 
line platform (patient not present) that allows the observer 
ftill latitude to visualize and contour the lumpectomy cavity 
using several manual and semi-automated contouring tools 
and [2] 'Guide Mode', an on-line platform (patient present) 
which allows the observer to contour a live 3DUS acquisi- 
tion using a manual approach, a 5-point semi automated 
contouring approach, or by overlaying the patient s position 
reference volume (an imported 3DUS structure defined on 
previous 3DUS) on the current 3DUS scan. 

A daily quality assurance program was developed and im- 
plemented to ensure the integrity of the Clarity System within 
the CT simulator room was accurate to within 1.0 mm. 

Image acquisition 
Simulation (CT1 and US1) 

At CT simulation patients were positioned on a breast 
board with the ipsilateral arm abducted (Figure la). Radio- 
opaque wire was used to mark the surgical scar and breast 



and radio-opaque skin markers were set on anterior mid- 
line and right or left mid-axilla lines, half-way between the 
superior and inferior border of the wired breast. The 
co-ordinates of the LAP laser were recorded to ensure 
consistent set-up on subsequent CT and US image acqui- 
sitions. Standard 3 mm CT slices were obtained using a 
dedicated CT-Sim (GE Lightspeed, 80 cm aperture). Im- 
mediately following acquisition of the planning CT data 
(CTl), while the patient was instructed not to move, the 
CT couch was repositioned 500 mm inferior of the CT 
origin. Scar wires were removed and a 3DUS (USl) was 
acquired, in Workstation Mode', by a radiation therapists 
using high viscosity gel to minimize breast deformation 
and optimize image quality. 

Image guidance (CTl and US2a, b & c) 

Patients returned 14-21 days after their initial planning 
simulation. All patients were once again placed on the 
breast board and radio-opaque markers were placed on 
the skin reference tattoos. Patients were then aligned using 
the LAP lasers, which were set using the initial planning 
simulation recorded values. A second CT dataset (CT2) 
was acquired using the CT simulation protocol described 
previously. Following CT scanning, the patient was trans- 
lated 500 mm and three sequential 3DUS image sets (total 
of 3 US images = US2a, b&c) were acquired by three RTs 
using the Clarity system in 'Guide Mode' (Figure lb). 

Image registration 

CTl and CT2 image sets were co-registered in 'Work- 
station Mode' by a single radiation oncologist by first 
applying an automated technique and then by adjust- 
ing manually for fine tuning. US2a, 2b, and 2c were auto- 
matically co-registered to USl in Guide Mode using 
the Clarity in-room coordinate system and LAP laser 
co-ordinates. 

Seroma contouring 

CTl and CT2 seromas were contoured "off-line" in 
'Workstation Mode' by a single radiation oncologist ex- 
perienced in partial breast radiotherapy. Similarly, USl was 
contoured "off-line" in 'Workstation Mode' by the study 
RT who performed the initial 3DUS acquisition. US2a, 
b&c were contoured "off-line" in 'Guide Mode' by five RTs 
involved in the study to reproduce the conditions of 3DUS 
image guidance at the time of treatment. To promote 
consistency and speed, RTs were instructed to contour 
US2, for comparison with USl, using the 5-point semi- 
automated approach available in 'Guide-Mode' using the 
positioning reference volume from USl as a guide only. 

Seroma shift calculation 

The 'seroma shift' represents the change in patient pos- 
ition required to align the seroma at the time of treatment 
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(a). Step 1- Simulation 




USl 



(b). Step 2 - Image guidance 




Figure 1 Image acquisition and guidance process, (a) Imaging acquisition process at simulation. A simulation CT was acquired (CTl) followed 
by a single 3DUS scan (USl). USl picture shows the 3D US probe. CTl was contoured offline by a single RO while USl was contoured by a single 
RT. (b) Image guidance process at 'treatment'. A second CT was acquired (CT2) followed by three subsequent 3DUS scans made by three 
different RTs (US2a, US2b, US2c). CT2 was contoured by a single RO and a seroma shift was determined based on implicit registration of CT 
coordinates. US2a, US2b, and US2c were each contoured by 5 RTs and a seroma shift was calculated by comparing each contour with the initial 
USl. This study design allowed for an analysis of scanning variability (dashed line) and contouring variability (dotted line). 



(US2, CT2) to the seroma at the time of CT simula- 
tion (USl, CTl). Both CT and US shifts were deter- 
mined in each of the Cartesian directions (Right/Left, 
Anterior/Posterior, Superior/Inferior) by comparing the 
centroid (geometric center of the seroma) contoured at 
the time of image guidance to the centroid location 
of the seroma contoured following simulation. Shift cal- 
culations were made off-line'. Calculated shifts were not 
used to position the patient during the actual treatment 
course. 



Statistical analysis 
Subjects included in analysis 

Subjects were excluded from analysis if they did not 
meet PBI dosimetric constraints [12] or had poor ser- 
oma clarity [11]. Seroma clarity on both CTl and USl 
was assessed using a previously described 6 point scale 
(0 = no visible seroma to 5 = clear, homogeneous seroma 
with sharp boundaries) [11]. Each seroma was assigned a 
consensus score after joint review by a multidisciplinary 
team (physics, radiation oncology, RT). A seroma clarity 
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of < 2 (seroma identifiable but with significant uncertain- 
ties) was deemed too poor for PBI targeting and subjects 
were excluded from analysis. 

3DUS seroma shifts 

US seroma shifts were determined by the five RTs on the 
three subsequent US scans taken at the time of image 
guidance (Figure lb). For further investigation a vec- 
tor defined by a spherical volume of interest with ra- 
dius = [(R/L)^ + (A/P)^ + (S/I)^]^-^ was calculated. This 
vector defines a three-dimensional region about which 
the seroma centroid should be located. The vector ra- 
dius is of cUnical interest as it helps define potential 
target margins. 

Comparison with CT seroma shifts 

Absolute mean shifts in each of the Cartesian directions 
for seromas contoured on US (USl - US2) were com- 
pared to absolute mean shifts determined by CT (CTl- 
CT2) for each patient. Shift vectors for seromas contoured 
on US and CT were compared. 

3DUS operator variability 

A Two- Way ANOVA at the 95% confidence level (a = 0.05) 
was applied for each subject. Variability introduced by mul- 
tiple 3DUS scan acquisitions (scanning variability) was 
assessed for each patient by comparing the mean centroid 
displacement between US2a, US2b, and US2c (Figure lb). 
Similarly, variability introduced by multiple operators con- 
touring individual US images (operator variability) was 
assessed by comparing centroid displacement determined 
between operators on an individual US scan acquisition 
(Figure lb). ANOVA was used to determine mean intra- 
operator and inter-operator seroma shifts for the entire 
patient cohort and to compare the mean standard devi- 
ation (SD) among observers. 

Time requirements for 3D US IGRT 

Estimates were recorded for the time taken to acquire 
an US image at simulation (USl), to contour the initial 
US (USl) offline, to acquire subsequent US images (US2a, 
US2b, US2c), and to contour those images offline. 

Results 

3D US clarity and PBI eligibility 

Clinical characteristics and factors affecting PBI planning 
are outlined in Table 1. Of the 28 subjects who under- 
went USl/CTl, 13 were excluded due to poor CT 
seroma clarity, failure to meet dosimetric constraints or 
incomplete US data acquisition (Figure 2) including one 
patient with no identifiable seroma at the time of ultra- 
sound, but a CT seroma clarity score of 4. No factors 
that were predictive of poor CT seroma clarity, PBI plan- 
ning failure, or poor US seroma clarity, were identified. 



Table 1 Clinical, pathologic and initial imaging 
characteristics of consenting subjects (n = 28) and the 
analyzed subset (n = 15) 



Age (years) 

Median (range) 

Histology n (%) 

Invasive Ductal 

Ductal Carcinoma in Situ 

Pathologic tumour size (cm) 

Median (range) 

Grade (Invasive Ductal) n (%) 

I 

II 
III 

Estrogen receptor status 

Positive 
Laterality 

Right 
Left 

Seroma location 

Inner/central 
Lower/outer 
US clarity score 

Mean 

CT clarity score 

Mean 

Breast volume (cc) 

Mean (range) 
Seroma volume (cc) 
Mean (range) 
Seroma: breast ratio 

Mean (range) 

BCS to CT simulation^ (weeks) 

Mean (range) 



Entire cohort Analysis cohort 

n = 28 n = 15 

68 (47-87) 72 (53-87) 

27 (96) 15 (100) 

1 (4) 0 

1 .2 (0.3 - 2.5) 1 .4 (0.8 - 2.5) 

8 (30) 6 (40) 

16 60) 8(53) 

3(11) 1(7) 

26(92.8) 14(93.3) 

12(42.8) 6(40.0) 

16(57.2) 9(60.0) 

1 1 (39.3) 5(33.3) 

17(60.7) 10(66.7) 

2.7 3.1 

3.1 3.6 

1429 (711 - 2088) 

32 (7 - 157) 21 (6 - 50) 

0.01 8 ±0.01 5 0.0.01 5 ±0.01 3 

8.8 (4.4- 13.4) 9.5 (5.9- 13.3) 



1732 (712 - 3877) 



Magnitude of 3D US shifts 

Figure 3 shows the mean shifts in each of the Cartesian 
directions for the 15 subjects using all operator and US 
data. The minimum and maximum shifts in any direc- 
tion were 0.2 mm and 10.5 mm respectively. Mean abso- 
lute US shifts were 3.1 mm, 3.3 mm, and 3.5 mm for R/L, 
A/P, and S/I directions respectively. Mean seroma shift 
vectors ranged from 0.9 mm to 10.9 mm with a mean and 
standard deviation of 6.6 mm and 2.6 mm respectively. Eight 
of the 15 patients (53%) demonstrated a shift >5.0 mm in 
at least one of the Cartesian directions. 10 of the 15 
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Eligible Patients Consenting to Study 
100%(n = 28) 



Failed PBI planning constraints 
17.9% (5) 



Low CT Seroma Clarity (<2) 
17.9% (5) 



Incomplete US Data 
10.7% (3) 



Included in analysis: 
»CT seroma clarity sufficient contouring 
•Complete US data 
»PBI planning successful 

53.6% (n = 15) 



Figure 2 Consort diagram of patients eligible for study, reasons for exclusions and those included in final analysis. 



patients (66.6%) demonstrated a vector shift > 5.0 mm and 
2 (13.3%) exceeded 10.0 mm. 

Comparison with CT shifts 

Mean shifts for CTl to CT2 as determined by a single 
RO were 2.4 mm, 3.3 mm, 2.2 mm for R/L, A/P, and S/I 
directions respectively and are comparable to shifts as 



determined by US. Mean seroma shift vectors for CT 
ranged from 0.5 mm to 11.7 mm with a mean and standard 
deviation of 5.5 mm and 2.8 mm respectively. Nine subjects 
(60.0%) demonstrated a vector shift > 5.0 mm and one pa- 
tient (6.7%) exceeded 10.0 mm when CT was employed for 
image guidance. The mean and standard deviation for the 
three Cartesian and the vector shift determined using CT 



15 



10 



in 

I 

CM 
0) 



-10 




Ml 



10 1 



13 



1 



Patient # 



□ Right/Left 

□ Ant/Post 
■ Sup/I nf 

□ Vector 



Figure 3 Mean US seroma shifts and vectors; R/L (white); A/P (grey); S/I (black); Vector (marble) for 15 subjects. Each shift or vector was 
the mean of 15 shift calculations per patient (5 RTs x 3US). 
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Figure 4 Comparisons of US and CT shifts in the (a) Right/Left (b) Ant/Post and (c) Sup/Inf directions. Error bars represent the standard 
deviation among tine US2a, 2b, and 2c sliifts relative to USl. 
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or US were comparable when considering the entire patient 
population. However, Figure 4 shows that on a patient by 
patient basis shifts determined using CT or US demon- 
strated no statistical correlation. 

3DUS scanning and operator variability 

Table 2 shows that seroma shifts determined from mul- 
tiple scan acquisitions (scanning variability) were sta- 
tistically indistinguishable (p = 0.42) with an expected 
standard error in the mean of 0.6 mm in any direction. 
Over an interval of ± 1.1 mm the seroma shift could be de- 
tected with confidence (a = 0.05) on multiple US scans. 
Seroma shifts determined between operators on the same 
US scan (operator variability) were statistically indistin- 
guishable (p = 0.19) with an expected standard error in 
the mean from repeated shift calculations on different 
US scans being 3.2 mm in any direction. Over an interval 
of ±6.2 mm the seroma shift could be detected with 
confidence (a = 0.05) by different operators on the same 
US scan. 

ANOVA was employed to calculate standard devia- 
tions in mean seroma shifts. Inter-operator standard 
deviation means were 2.6 mm, 2.1 mm, and 3.0 mm for 
R/L, A/P, and S/I directions respectively. Intra-operator 
SD means were 2.2 mm, 2.1 mm, and 2.8 mm for R/L, 
A/P, and S/I directions respectively. A substantial oper- 
ator effect was observed in the intra-operator variability 
in seroma shift determination (Figure 5a). SD in seroma 
shifts between operator 1 and operator 5 differed by a 
factor of almost 2 in all directions. Differences between 
mean US shifts for each operator and the CT shifts cal- 
culated by a single RO demonstrate that the operators 
with the least variable US results also correlate better 
with the CT results (Figure 5b). 

Time requirements for 3D US IGRT 

The mean and SD time necessary to acquire the US 
image taken at simulation (USl) was 13 ± 4 minutes. 
The mean and SD time taken to contour the USl offline 
was 7 ± 3 minutes. The mean and SD time taken to ac- 
quire and contour each of the US images offline using 
the semi-automated 'Guide Mode' as the surrogate for 
treatment (US2a, US2b, US2c) was 11 ± 4 minutes. 

Table 2 ANOVA results for variability in seroma shift 



determination introduced as a result of multiple US scan 
acquisitions (scanning variability) and multiple operators 
contouring on a single US scan (contouring variability) 





Scanning 


Operator 




variability 


variability 


Standard error in measurement (mm) 


0.6 


3.2 


95% confidence interval (mm) 


1.1 


6.2 


P-value 


0.42 


0.19 



Discussion 

One concern for the use of US as a tool for image guid- 
ance is that US scanning involves a certain pressure that 
can cause the breast tissue to deform at the time of im- 
aging. However, several studies have examined the effi- 
cacy of 3DUS for daily localization of the surgical bed 
and have reported good correlation of 3DUS with CT in 
its ability to localize and track target displacements 
[10,11]. The current study sought to determine the ex- 
tent to which operator variability in 3DUS acquisition 
and seroma contouring contributed to seroma shift dif- 
ferences calculated for breast IGRT. 

In clinical practice it is likely that multiple operators 
would be involved with the acquisition, contouring, and 
patient repositioning if 3DUS IGRT was utilized. There 
are many factors that may confound the accuracy of the 
localization of the target between fractions. We have 
defined "scanning" variability to encompass those poten- 
tial sources of variability related specifically to image 
acquisition. Scanning variation included differences in 
US scan settings, patient breathing during image acquisi- 
tion, probe pressure [12] and scanning direction. Scan- 
ning variability was assessed by comparing seroma shifts 
between multiple 3DUS scans. Similarly, we have de- 
fined "operator" variability to encompass those poten- 
tial sources of variability related specifically to the seroma 
contouring. Contouring variation included image window 
and level settings, contouring strategy, and selection of 
the interpolation algorithm used for 3D contour ex- 
trapolation. To reduce contouring variation, the 5-point 
semi-automated approach, which proved to be the most 
consistent and accurate contouring method in a prelimin- 
ary study, was chosen for use in this study. Despite this 
attempt to standardize the approach to contouring our re- 
sults show that contouring variability contributes more sig- 
nificantly to the overall variability in seroma localization 
than the variability associated with multiple scan acquisi- 
tions. The data suggest that at the level of 95% confidence 
contouring variability contributes a mean uncertainly of 
6.2 mm in the determination of the seroma location com- 
pared to a mean uncertainty of 1.1 mm contributed by the 
variability from multiple scan acquisitions. 

Our results demonstrate a clear difference between the 
RT operators that participated in the study. Operators 
with the least variable 3DUS results had better correl- 
ation with seroma shifts determined using CT. Opera- 
tors all had similar levels of experience, were all trained 
in the same manner, and were not systematically moni- 
tored throughout the scan acquisition or contouring. 
Therefore, suggesting what technique or process allowed 
some therapists to systematically arrive at better results 
than others would purely be speculative. However, the 
factor of two observed in the standard deviation in seroma 
shifts between the most extreme operators provides 
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Figure 5 Comparison of intra-operator variability on US to CT shiifts. (a) An operator effect was observed in the intra-operator variability 
(sliift standard deviation) in seroma sliift determination, (b) Differences between mean US sliifts for eacli operator and tine CT sliifts calculated 
by a single RO demonstrate that the operators with the least variable US results also correlate better with the CT results. 



sufficient motivation to furtiier explore inter-operator pro- 
cedural differences to improve the consistency of 3DUS 
IGRT in practice. 

In our study, the mean and SD seroma shift vectors 
were 6.6 ± 2.6 mm and 5.5 ± 2.8 mm for 3DUS and CT 
respectively. While this is suggestive of good correlation 
between 3DUS and CT it disguises substantial variation 



between the 3DUS and CT shifts of an individual 
patient. In fact, there was no correlation observed between 
3DUS and CT when comparing individual Cartesian shifts. 
The seroma shifts determined using 3DUS, however, are 
comparable to CT being mindful that any discrepancies 
observed are more reflective of measurement "noise" than 
true differences between imaging modalities. 
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The mean seroma shift should inform an adequate 
PTV margin necessary to ensure proper coverage when 
IGRT is not used. Wong et al [10] used 3DUS IGRT for 
20 patients and measured an average target displacement 
of 10.8 ± 6.3 mm from the treatment plan. The authors 
suggest that a margin of 23.4 mm (mean plus 2 SD) may 
be needed for electron boost or PBI to ensure the target 
is covered > 95% of the time when IGRT is not used. We 
measured a mean seroma shift vectors of 6.6 ± 2.6 mm. 
This suggests that a margin of 11.8 mm may be needed 
for electron boost or PBI to ensure that the target is cov- 
ered > 95% of the time when IGRT is not used. It should 
be recognized, however, that of the 15 patients in our 
study 10 (66%) demonstrated a vector shift > 5.0 mm and 2 
(13.3%) exceeded 10.0 mm. Suggesting that a much larger 
margin is required in the absence of IGRT. Additionally, 
while the margins suggested by our results improve on the 
results of Wong et al. [10] by almost a factor of two, this 
may be attributed to stricter patient eligibility in our study. 

The seroma shifts observed in our study were in many 
cases in excess of the CTV to PTV growth used by Kirby 
et al [7] and those used in ongoing trials evaluating 
external beam [13]. This emphasizes the need for daily 
image guidance for PBI to avoid unreasonably large 
margins or under-treatment of the CTV. 

Conclusions 

Variability introduced by multiple scan acquisitions or 
by multiple operators contouring 3DUS images does not 
contribute significantly to seroma shifts. Seroma shifts 
for IGRT determined using 3DUS are of similar magnitude 
to CT. 3DUS IGRT requires approximately 15 minutes at 
simulation and 11 minutes per IGRT fraction at treatment. 
An observed inter-operator effect suggests future work to 
minimize variability and may improve the efficacy of 3DUS 
as an IGRT tool for breast PBI. 
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